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Abstract. In this paper, we consider the infinite-dimensional integration problem on weighted 
reproducing kernel Hilbert spaces with norms induced by an underlying function space decomposition 
of ANOVA-type. The weights model the relative importance of different groups of variables. We 
present new randomized multilevel algorithms to tackle this integration problem and prove upper 
bounds for their randomized error. Furthermore, we provide in this setting the first non-trivial 
lower error bounds for general randomized algorithms, which, in particular, may be adaptive or 
non-linear. These lower bounds show that our multilevel algorithms are optimal. Our analysis 
refines and extends the analysis provided in [F. J. Hickernell, T. Miiller-Gronbach, B. Niu, K. Ritter, 
J. Complexity 26 (2010), 229-254], and our error bounds improve substantially on the error bounds 
presented there. As an illustrative example, we discuss the unanchorcd Sobolev space and employ 
randomized quasi-Monte Carlo multilevel algorithms based on scrambled polynomial lattice rules. 
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1. Introduction. Motivated by applications arising e.g. in quantitativ finance 
or physics, see |10[ I36| . there has recently been done a large amount of research 
investigating integrals over functions with apriori unlimited or even infinitely many 
variables. Multilevel algorithms, [T71[TU], have been successfully used to solve these 
problems. Furthermore, multilevel algorithms have been successfully combined with 
QMC methods, [TT], which turned out to be more efficient than plain Monte Carlo 
(MC) or quasi-Monte Carlo (QMC) algorithms, respectively. 

Researchers in information-based complexity started to study the complexity of 
the infinite-dimensional integration problem on weighted reproducing kernel Hilbert 
spaces of integrands with norms induced by function space decompositions of anchored 
or ANOVA-type [H HOI III US HllMlll] • (For function space decompositions we refer 
to |21|.) For many spaces of integrands good lower bounds for the deterministic worst- 
case integration error have been proved and constructive upper bounds for different 
error criteria have been established with the help of multilevel [HI EH [T2j [2] and 
so-called changing dimension algorithms [20\ I32j . For some settings these bounds 
arc sharp. Nevertheless, the randomized setting and the case of function spaces with 
norms induced by ANOVA-type decompositions are so far not well enough understood; 
see also the comments in jl8j or, for integration in the randomized setting in general, 
in |28[ p. 487]. The main reason for this is that the randomized setting and the 
ANOVA setting are technically demanding and more difficult to analyze than the 
deterministic worst-case setting and the anchored setting. But the former two settings 
are particularly interesting and very important. The (deterministic) worst-case error 
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is often unnecessarily pessimistic and ftirthermorc suitably randomized algorithms can 
achieve higher convergence rates and additionally provide statistical error estimates. 
ANOVA decompositions have been used to explain the success of QMC methods 
for financial applications, see e.g. [3Tl|4l[35]: If the effective dimension, see [4], of 
the integration problem is small, i.e. the variance is concentrated in the lower-order 
ANOVA terms, QMC methods can be expected to perform well. Furthermore, in [22] 
and [iSl [16] it was shown that lower order ANOVA terms exhibit more smoothness 
than the corresponding function itself. 

In |18] the convergence rates of randomized multilevel algorithms for infinite- 
dimensional integration on Hilbert spaces with product weights are analyzed. But as 
the authors admit in their paper, in the ANOVA case their analysis has unfortunately 
some limitations. An undesirable consequence of this shortcoming is that they are 
only able to study a very restricted class of multilevel algorithms. Non-trivial lower 
bounds for the errors of randomized multilevel algorithms are not provided in |18j . 

In this paper we refine the analysis from |18] and extend it to other kinds of 
weights. As a result we are able to study new multilevel algorithms and to estab- 
lish good upper error bounds for their performance. In the case of product weights 
our upper error bounds improve substantially on the ones given in |18| and [5]. A 
key indegredient for our analysis of multilevel algorithms is the "ANOVA invariance 
lemma" , Lemma 12.11 We also provide the first non-trivial lower bounds for the iVth 
minimal errors of randomized multilevel algorithms (or, to be more precise, of general 
randomized algorithms in the variable subspace sampling model introduced in [5]; for 
lower error bounds for the A^th minimal errors of deterministic and randomized algo- 
rithms in the case of anchored decompositions in the former model and the cost model 
introduced in [20] we refer to the new preprints (6l[l3|). These lower bounds show 
that our constructive upper bounds arc tight for both types of weights considered, 
namely finite-intersection weights and product weights. (Similar optimal results for 
multilevel algorithms are achieved in |Q in the deterministic worst-case setting for 
norms based on anchored function space decompositions.) Furthermore, as done in 
[18] for product weights, we provide for finite-intersection weights sharp upper and 
lower error bounds for single-level algorithms (or, to be more precise, upper bounds 
for specific and lower bounds for general randomized algorithms in the fixed subspace 
sampling model defined in [5]). Our analysis tools can also be used to investigate the 
convergence rates of other randomized algorithms, as, e.g., the randomized changing 
dimension algorithms from [32] , in the ANOVA setting. 

The paper is organized as follows: In Section [5] we recall preliminaries, but also 
provide new lemmas which are important for our error analysis. In Section [3] we pro- 
vide lower bounds for the randomized errors of general randomized algorithms and 
general weights. We specify these bounds for finite-intersection and product weights. 
In Section [4] we present our multilevel algorithms for general weights and provide 
concrete error bounds for finite-intersection weights in Theorem 14.31 and for prod- 
uct weights in Theorem 14.51 In Section [S] we consider a concrete space of functions 
of infinitely many variables and show that multilevel algorithms based on scram- 
bled polynomial lattice rules are essentially optimal for finite-intersection and product 
weights. 

2. Preliminaries. Let us make some remarks on notation: For n € N we denote 
by [n] the set {l,2,...,n}. For a finite set u we denote its cardinality by We 
use the common Landau 0-notation. For two functions / and g we write occasionally 
/ = fi(.g) for g = 0{f), and / = G(.g) if / = f^(g) and / = 0{g) holds. If we consider 
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a reproducing kernel K , then we always denote the corresponding reproducing kernel 
Hilbert space by H{K) and its norm unit ball by B{K). The norm and the scalar 
product of H{K) are denoted by \\-\\k and (•, ■) k, respectively. Our standard reference 
for reproducing kernel Hilbert spaces is [Tj . 

2.1. The ANOVA decomposition. In this section, we recall the ANOVA de- 
composition of L^-functions; the acronym "ANOVA" stands for "Analysis of Vari- 
ance". Let (r2,S,P) be a probability space, and denote its d-fold product space by 
{Vf^, E'^,P'^). The ANOVA decomposition of an L^.f^nction / : ^l'^ ^ R is 

^ (2.1) 

u<Z[d] 

where /„ denotes the ANOVA-term corresponding to the set u. For u C [d] and 
X gVL'^ let Xu := {xj)jeu e ^2". For Xu G ^2" and uj G rjI'^lV" let (a;„,a;) € D.'^ be the 
vector whose jth component is Xj if j G li and LOj otherwise. The ANOVA-term 
can be computed recursively via 

Ux) = / /(a;„,w)pM\"(dc^) - V U{x) , where = / ,f{u:)¥\duj). 

Furthermore, it can be shown via induction over that 

fu{x)'^{dxj) = for aU j G u. (2.2) 
The important feature of the ANOVA decomposition is 

Var(/) = Var(/u). (2.3) 

llC[d] 

Let {D,T,',p) be another probability space. The new randomized algorithms for 
infinite-dimensional integration we present here, rely on random quadratures that 
use n (deterministic) real coefficients Wi and n randomly chosen quadrature points 
a;'-^'(w), . . . ,a;^"^(cj) in D'^, i.e., that have the form 

g„(w,/) = ^u.,/(a;W(c.)) 

1=1 

for / G L'^{D'^, p'^), UJ G fi''. We assume that for fixed / the function uj (3,i(a;, /) is 
square integrable. The next lemma is crucial for the proof of our upper error bounds 
for multilevel algorithms; it says that under a certain condition the wth ANOVA-term 
of the L^(r2'^, P'')-function Qn{-,f) is equal to Qn applied to the wth ANOVA-term 
of the L2(i:)'^,/ci'')-function /. We denote the ANOVA-terms of Qn{-, /), regarded as 
a function on 51'', by [(5n(', /)]„, u ^ 

Lemma 2.1 (ANOVA Invariance Lemma) . Let (f2, S, P), {D,T,\p) be probability 
spaces. Let c? G N, and let V be a subset of ttie power set of [d] . Assume ttiat 
Qn = Q[d],n, given by 

n 

Q„(w,/) =^u;,/(a;W(c^)), G 17^ «;i, . . . , u;„ G M, / G ^^(I?^ p'^), (2.4) 
1=1 



is a randomized linear algorittim wtiich satisfies the following condition: 
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(*) For all iJ e V the random points a;i'' — (x^*' {uj))j^^ G -D", i = 1, . . . , ri, are of 

the form a;i'' = [x"^'^ {uij))j^v, and the random variables x^^^ are distributed 
according to the law p. 
Then we have for each f € L^{D'^,p'^) whose ANOVA terms f^ vanish if v ^ V that 

[Qni;f)]u = Qn{-Ju) for all uC[d]. (2.5) 



Proof Wc prove (|2.5p by induction on \u\. So let first u = 0. Then, due to (|2.4 
2J|) . and condition (*), 

[Q{-J)h^ f Q(c.,/)P'^(dc^) = Vm, / /(a;WH)P''(dc.) 

n „ n „ 

= E^^E / /u(^<'n^))p'(dc.)-E^'' E / /"Wd/(^) 

f[x)p\x)^Q{-J^). 



4=1 



Let now % ^ v Q [d], and let us assume that (|2.5p holds for all u with |m| < \v\. Then 
we have for ct € SI'* 

[Q{-JM(r)= I 0((a.„,L.),/)pM\-(da;)-^[Q(.,/)]„(a). 



u(Zv 



Now 



/ Q((a„,w),/)p['*lV"(dw)= Vt^, / /(a;W(a,„,L.))p[''l\''(dw) 

n ^ 

= E^''E / /n(=r«(a„,a;))pM\^'(dw)- 

Notice that the last integral is zero if u is not a subset of v, due to condition (*) and 
for u G V and due to /„ = for u ^ V. Since the ANOVA terms /„, u C w, 
depend only on the variables in v, we thus get 

/. n 

/ Q((a., c.), /) P[''l\''(dc.) = E "'^ E fui^^'H'^)) = E ^?('^' /«) 

= Q(a,/.) + 5][0(-,/)]„(a), 

where the last step uses the induction hypothesis. Hence /)]„(cr) = Q{o, /„), and 
the proof is complete. □ 

Remark 2.1. In the case where the set V in Lemma \2.1\ is the whole power set 
of [d], we may say that Qn is invariant under the ANOVA decomposition. Note that 
for general subsets V of the power set of [d] and f G L^{D'^,p'^) with fv=0 for all 
V ^ V condition (*) of Lemma \2.1\ implies that Qn{',f) is square integrable on ^l'^ 
and, if additionally 

n 

5^«^4 = 1 (2.6) 
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holds, an unbiased estimator of f{x) p'^{dx). 

2.2. Classes of weights. Let 

{u C N| |u| < oo}, 

and let 7 = {Ju)ugu be a sequence of non-negative weights. The weights 7 are cahed 
product weights, |33] , if there exists a sequence of non- negative numbers 71 > 72 > • • • 
such that 7„ = Y[j£u 7j " ^- ^^^e weights 7 are caUed finite-order weights, 

[9], of order cj if 7„ = for all u with |u| > uj. We are particularly interested in 
some subclass of finite-order weights. We restate Definition 3.5 from [l2] . 

Definition 2.2. Let p G N. Finite-order weights {'ju)ueu are called finite- 
intersection weights with intersection degree at most p if we have 

\{vGU\-fy>Q,uC^v^^\<l + p for all ueU with ju>0- (2.7) 

Note that for finite-order weights of order ut condition (|2.7|) is equivalent to the 
following condition: There exists an S N such that 

\{ueU\-fu>0,keu}\<7j foraUfcGN. (2.8) 

Indeed, if (|2.7p is satisfied, then (|2.8p holds with 77 < I -\- p, and if (|2.8p is satisfied, 
then (|2.7p holds with p < {rj — 1)uj. A subclass of the finite-intersection weights are 
the finite- diameter weights proposed by Creutzig, see, e.g., [T21[37]. Let us restate 
Lemma 3.10 from |12] , which will be essential for our analysis of finite-intersection 
weights. 

Lemma 2.3. Let {'^u)ueu he finite-intersection weights of finite order lj. Letrj e N 
be such that h2. <$|) is satisfied. Then there exists a mapping : N — > — 1) + 1] 
such that for all u Cz U with 7^ > the restriction is injective. 

2.3. Function Spaces. Let £> C R, p a probability measure on D, and p := 
®„gN P the product probability measure on . Unless stated otherwise, we denote 
by u, V, and w finite subsets of N, i.e., u,v,w £ U. In many formulas wc will not state 
this explicitly, to make our notation not too cumbersome. Let {•^u)ueu be a sequence 
of non-negative weights. 

In this paper we make essentially the same assumptions as in |18l Sect. 2]. 

Assumptions 2.1. We assume that 
(A 1) k ^ is a measurable reproducing kernel on D x D which satisfies 
(A 2) H{k) n H{1) = {0} as well as 
(A 3) M := k{x,x)p{dx) < 00. 
(A 4) 70 = 1 and 

7„mI"I < 00. (2.9) 

It is easily verified that for product weights and finite-order weights condition 
(|2.9p can be replaced by the equivalent condition X^mgw^" ^ 

For u G U wc put ku{x,y) :— Hjeti ^(^ji '^'-'^ x,y £ . In particular, 
kii){x, y) = 1. We define iJ„ := iJ(fc„), i.e., is the reproducing kernel Hilbcrt space 
with kernel k^- The following lemma stems from [18j . 

Lemma 2.4. Let x,y e and f G If Xu = y^, then f{x) = /(y). 

Given v Cz U we define the weighted kernel K^{x,y) := '^y^i^^luku{x,y), for 
x,y £ D^. For the next lemma see [1^1 Lemma 3] or [1] I, § 6]. 
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Lemma 2.5. The reproducing kernel Hilbert space H{Ky) consists of all functions 
/ = Y^uCvfu, for fu e Hu. Furthermore, \\f\\j^^^ = E„o, 7u ^ll/ull^- 
In general we follow the convention that oo • = 0. Note that 7^ = implies 
/„ = for all / G HiK^); in that case 7"^||/u||fc„ = 0. 

Due to Lemma [2.41 we can consider the spaces H{ku) and H{Ku) as spaces of 
fmictions on Z?". In this case we have H{ku) — ®jizuH{k), and H{Ku) is a tensor 
product space if and only if the weights {'~fu)u&A are product weights, see, e.g., [U I, 
§8]. 

Let us define the domain X of functions of infinitely many variables by 



^luWk{xj,Xj) < oo L 



(2.10) 

Similar as in [HI Lemma 1] one shows that X satisfies /^(X) = 1. For x,y £ X we put 

K{x,y) ^ 7„fc„(a;,y). 

u&A 

Since K is well-defined, symmetric, and positive semi-definite, it is a reproducing 
kernel on X x X, see [1]. For the next lemma see [191 Cor. 5] or [14] . 

Lemma 2.6. The reproducing kernel Hilbert space H[K) consists of all functions 
f = J2ueu /« that 

J2^u'\\fu\\l<00. 

In the case of convergence, we have 

I1/I1k = E^«'II/"III- (2.11) 

ueu 

If / e H{K), then the decomposition 

/ = 51 (2.12) 

ueu 

is uniquely defined, since /„ is the orthogonal projection of / onto 

2.4. Integration. Integration with respect to the probablitiy measure /x defines 
a bounded linear functional 



/(/):== / f{x)pi{dx) 
Jx 

on H{K), as verified by the following estimates: 

/ \f{x)\f^idx)^ [ \{f,K{;x))K\l^{dx)<\\f\\K I \\K{;x)\\KlJi{dx), 

Jx Jx Jx 

and 

( f \\K{;x)\\KKdx)) < I \\K{;x)\\\y.{dx)^ I K{x,x)pi{dx)<Y^^M- 
\Jx J Jx Jx 
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and the last term is finite due to (|2.9p . The representer h G H{K) of the integration 
functional / is given by 

h{x) = {h, K{; x))k = K{x, v) A*(dy). (2.13) 

Similar as above, it is easily shown that for every u G iJ„ 

Iu{f) := / f{x)p''{dx) 

J 

defines a bounded linear functional on Hu- It is also easily shown that H{K) C 
L^(j£, /x) and Hu C L^{D'",p^) for all u E U. For the rest of this article we assume 
that the following assumptions hold: 

Assumptions 2.2. We assume that 
(A 2a) Jjj k{x, y) p{dx) for all y e D. 
(A 5) For all a & D we have k(a, a) > 0. 

Note that assumption (A 2a) and identity (|2.13p immediately imply that 

h{x) = 1 for aU xeX. (2.14) 

Thus, if there exists an a* G D with k{a*,a*) = 0, then this results for a* := (a*)jgN 
in A'(-,a*) = h, which leads to /(/) = f{a*) for aU / e H{K). Assumption (A 5) 
avoids this trivial integration problem. 

Under assumption (A 2a), the uniquely determined decomposition (|2.12p is in 
fact the ANOVA decomposition of /, see Remark l2.3l 

2.5. Projections. Let us choose an anchor a S X. Here the most interesting 
case seems to us a vector a whose entries are all equal to a, where a €z D satisfies 

^7„fc(a,a)l"l < oo; (2.15) 

note that condition (|2.9I) ensures that such an a exists. For the sake of generality 
we will consider a general a G X. But to make proofs not unnecessarily complicated, 
we will restrict ourselves to anchors a = (a,a, ...) S X for the concrete analysis 
of our constructive multilevel algorithms in the case of product weights and finite- 
intersection weights. 
We define ioi u gU 

{^u.a.f){x) := f{xu]a) for all x 

where {xu]<i) '■= {xu,a'n\u)- Note that due to (|2.15p we have {xu]a,) G X. 
For u,v,w Cz U with u C_ v d w we define 

fu,v ■= •^"U"' ^'^^^ fu,v,w ■= X] ■^"U"', (2.16) 

u'Gti\v ii'CN\-u ; M'ntO5^0 

as well as 

rl,u,a-^ luuu' ku'{a,a) (2.17) 

u'CN\u 
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and 



f2 

w.v.u.a 



^ juuw ku'{a,a)- (2.18) 

u'CN\v ; u'nw^(ll 



Since a e X, the quantities r„^u.a and f.u,^v,u.a are finite. Furthermore, we have 

'w,v,u,a — v.u,a lU' 

Remark 2.2. Observe that we have the orthogonal decomposition 

f = J2fu,v for all f e H{K) and all v eU. (2.19) 



For a fixed f G H{K) and v d w the functions fuv wj u ^ v. form an orthogonal 
function system in H{K). 

Lemma 2.7. For all f G H{K) and all finite subsets u Q v G w of N we have 
^v,aifu,v)i^v,aifu,v,w) ^ and the norm estimates 

||*..a(/„+J||fc„ <r,.„,„||/+J|A' (2.20) 

and 

ll*-,a(/„:„,.JIU-„ <r„.„,.,a|l/-„,,„|k. (2.21) 

Furthermore, '^v,a is a bounded projection from H{K) onto H{Ky), and its operator 
norm is given by 

W'^vAk-^k^ = max 7-i/V„,„,a. (2.22) 

uCLv ; 7u > 

Proof. To prove (|2.20p . we apply [THl Lemma 15]: Put 

:= D'' and f| L G D^^'' ^ 7„u«' J] ^^^o^^o) < ^\ 



ti'CN\t> 



Since we assumed that there exists no a* G D with k{a*,a*) 0, it is easy to 
observe that X = i^i x E2, see also [13]. Put K'{x,y) := J2u'eu^'u' f^u'{x,y), where 
7^, := 7„/ if u' Hv — u and 7^, ~ otherwise. Let the reproducing kernel J be defined 
by J((a;i,a;2), (^1,2/2)) ■= K'{{xi;a),{y2]a)) for Xi,y^ G Ei, X2,y2 & E2. Then 

J{x,y)= ^ '^uuu' kuuu'{{xv;a),{y^;a)) 

«'CN\i> 

u'cN\v i^eu i/eu' 

Due to [m Lemma 15] we thus have 

{*«,a(/) I / e B{K')} = i?(J) = {/ G I ||/|U„ < r„,,,J. 

Observe that /+„ G B{K') and that due to (PTTTI) the right hand side in (P^^ is 
invariant under substituting the norm || • \\k by || • \\k'- Hence we have proved (j2.20p 
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and seen that the constant r^, „ „ appearing on the right hand side is optimaL The 
estimate (|2.2ip follows analogously. Due to Lcmma [^?5] and (|2.19p we get for / e B{K) 



I*.,a(/)||L = E 7.-'ll*.,a(/+JII 
'LiC'(;;7i( >0 



- lu^rl Wf+^W^i < max 7„V2 

^ ' ' ' llC-u;7„>0 

uClj;7ii >0 

If u* C V satisfies 7^."^7'^^„. „ = max„cu ; 7„>o 7« "^'^u,u,a; then we get for / G B{K) 
with / = /+^, 

ll*.,a(/+.,J||^„ = 7,7*'ll*.,a(/+.,J|lL. < lu>lu'...- (2.23) 

Recall that this inequality is invalid for some / with \\f^, = 1 if we decrease the 

_________ 1/2 

right hand side of (|2.23p . Thus \\^v.a\\K^K„ = max„c« ;7„>o 7u ''«,u,a- 
Remark 2.3. For u <eU and fu G Hu we have 

/ fuix) pidxj) ^ for all j e u, x e X. (2.24) 
Jd 

Indeed, assumption (A 2a) implies that \2.24^ holds for all functions y £ X. 

Since the linear span of these functions is dense in Hu, and since I^jj o "^[jy ^ is a 
continuous linear functional on Q H[K), identity \2. 24^ is valid. 

With the help of \2. 24-^ it is easy to show that for v Cz U and f G H{Ky) the 
uniquely determined decomposition f = X^uCu ^ exactly the ANOVA 

decomposition of f in L^{D^ , p^). (Similarly as in the proof of Lemma \2.1\ this can 
be shown by induction on \u\.) In this sense, the uniquely determined decomposition 
f = X^uGW ^ of f ^ Hi^"^) nothing but the infinite-dimensional ANOVA 

decomposition of f in L^{X,p). 

Remark 2.4. An interesting question is under what conditions on the weights 
the operator norms of the projections 5'u_a satisfy for some C > 

||«'«.a|k~>K„ < C forallveU. (2.25) 

(This question is in fact relevant for our lower bounds in Theorem \3.2i and Corollary 
\3.4\ ) It is easily seen that product weights 7 that satisfy i2. 9\) also satisfy \2.25\) . see 
also Lemma 7]. That this has not necessarily to be the case for general weights, 
even not for finite-intersection weights, shows the following example: Let Uj = a for 
some a Cz D and all j G N. For a given £ > let 

i^"^^^ if u = {j} for some j G N, 
7« = { j^^^" ifu = {j,j + 1} for some j G N, 
otherwise. 

The weights 7 = {^u)ueu we obtain in this way are summable finite-intersection 
weights. If j = maxf, then 112. 22\} implies 

\\^v,a\\K^K^ > 7{j-}'^?,b},a > ^^^'^^^^ k{a, a) = j k{a, a) -> 00 as j ^ 00. 
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For a vector a with identical entries a Cz D and finite-intersection weights 7 of order 
UJ and with intersection degree p the monotonicity condition 

7m ^ Iv for all u,v Cz U with u C_ v and 7^ > (2.26) 

is sufficient to ensure that \2. 25]) holds, since then we have for 0^uC_v,jy^>O 

lu'rlu,a< E fcKa)l"'l<(l + p)max{l,fc(a,an, 



and follows from and 

Lemma 2.8. For v,w <Ehl with v C w we have for all f <E H{K) 

u<Zv i/i^u'(Zw\v uC.v 

Proof. Let u € U satisfy u (1 v ~ u H w. Then, due to Lemma 12. 4[ we have 
'ifw,afu{x) = "iiv.afuix) for all X e X. Thus 

{'^w,a - f^.a)/ = (*u;,a - ^t-.a) EE E /"U«'U«" 

uCv $^u' Cw\v u"CN\'w 

~ 5^ '^w,a{fuUu',w) ~ '^v,a{fu,v,w)- 



Lemma 2.9. For any v we have 



sup |/(/) = ^ 7«fc«(a,a) 



Proof. Let /i^j^a, denote the representor of I o 5'„^a, in H{K), i.e., 

hv.a{x)^ A'(a;,(y„;a))p''(dy„) = E^n / fcu(a5,(yt,;a))p"(dy„) 

net/ 

Due to (|2.24p the last integral is zero if u n u 7^ 0. Hence 

hv^a{x) = E luku{x,a). 



uCfi\v 



Due to (|2.14p we have 



b.?,a= sup |/(/) = !|/^-/^^,.a!|^ = 
/es(K) 



iC 



: E 7u||fc«(-,a] 



iL E 7«fcu(a,a)- 



11 



2.6. Cost and error. In this subsetion we present the cost models introduced 
in [5]. Apart from shght generaUzations, we essentially follow the representation in 
[H Sect. 3]. 

For X e D^\X we put f{x) = for all / e H{K). Let ${iy), ly eNU {0}, be 
a monotone increasing cost function. Here we will usually assume that $(z^) = 0{i'^) 
(for upper error bounds) or = f2(^'') (for lower error bounds), where s > 0. 
(Corresponding results for the case s = can easily be obtained by taking the limit 
s 0; anyhow, we believe that the most interesting case is s > 1.) 

In the fixed subspace sampling model function evaluations are only possible in 
points from a finite-dimensional affine subspace 

Xv,a ■■= {xe D^'^l Xj = flj for all j G N \ v} 

of X for a given v G U and an admissable anchor a G X, and the cost for each function 
evaluation is given by a cost function 

c.,.(.) := l^d^l) (2.27) 
I oo otherwise. 

In the variable subspace sampling modeQ function evaluations can be done in a se- 
quence of affine subspaces 

,a ^ X^2,a ' ' ' 

for a strictly increasing sequence v = (ui)ieN of sets $ ^ Vi £ U and an admissable 
anchor a G X, and the cost for each function evaluation is given by the cost function 

Cv,a(a3) := inf{$(|v.|) | x G X,.,,}, (2.28) 

where we use the standard convention that inf ~ oo. Let Cfix and Cvar denote the 
set of all cost functions of the form (|2.27p and (|2.28p , respectively. 

In general we assume that all a G X are admissable anchors, but in some situation 
we restrict ourselves to admissable anchors of the form a = {a, a, ...)(£ X, a € D, as 
done in [18]. 

We consider randomized algorithms for integration of functions / G H{K) and, as 
in [18] , refer for a formal definition to [5l [26l |3j . The cost of an algorithm is defined 
to be the sum of the cost of all function evaluations. For a randomized algorithm Q 
the cost is a random variable, which may depend on the function /. That is why we 
denote this random variable by costc((3, /), where c denotes the relevant cost function 

from Cfix or Cvar- 

The worst case cost of a randomized algorithm Q on a class of integrands F is 
given by 

costiix{Q,F) :— inf sup E(costc((3, /)) 
in the fixed subspace sampling model and by 

C0Stvar(Q, ^') := Hlf SUp E(c0Stc((5, /)) 

CeCvar /gF 



^To distinguish this cost model clearly from the more generous one defined in 1201 it seems to be 
more accurate to rename it "nested subspace sampling model" as done in (6] 113) ; since here we do 
not consider the cost model from | 20| . we stay with the original name. 
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in the variable subspace sampling model. 

The randomized error e{Q,F) of approximating the integration functional / by 
Q on F is defined as 

e(Q,F):= sup E ((/(/) -0(/))')j . 

For iV G M let us define the Nth minimal errors by 

ejv,fix(i^) := inf{e(Q,F) | costfi,(Q, i^) < N} 

and 

eN,var(F) := inf{e(Q,^^) | cost^,,{Q,F) < N}. 

3. Lower bounds. For a fixed anchor a E X and a sequence of weights {'^u)u&j 
satisfying (j2.9p let ui, 1*2, . . . be an ordering of the non-empty sets u € U with 7„ > 
for which 7tti > 7u2 ^ ' ' ' holds, where 7^ := 7„ fc„(a,a). Let uq := 0. Furthermore, 
we put 



decay ..J, := sup {p E 



lim 7„, = 0f 



3.1. General weights. The next two lemmas are helpful for establishing lower 
bounds for the randomized error of numerical integration. 

Lemma 3.1. Let 9 G (1/2,1], v £U, and let Q be a randomized algorithm that 
satisfies P(Q(/) = Qi'^v.a.f)) > for all J e B{K). Then 

e(Q, B{K)) > max ( Z^!^,'""'" , e(Q, B{K,)) 

Proof. The proof adapts the proof idea from [THl Lemma 8]. Put f := ||^u,a||_fs' ->_;<"„• 
Then we have for / e B{K), 

a = ^^^eBiK). 
1 + r 

Furthermore, we have ^v.aig) = ^■u,a(~.9) = 0. Let A denote the event {Q{g) = 
Qi~g)}. Then ¥{A) > 26* - 1. Hence' 

e{Q,B{K)f > max{E ((/(.g) - Q{g)f) ,E ((/(-g) - Q{-g)f)} 
> max ( / (lig) - Q{g)f P(dc.), / (/(-.g) - Qi-g)) f P(dc^) 



>(2^^ - l)|/(.g)|2 = (20 - 1)(1 + r)-2|/(/) - /(*.,„(/))P . 

Since B (K^) C B{K), we have additionally e (Q, B(/C)) > e (Q, B{K^)). □ 

We provide now a general lower bound for the randomized error of arbitrary 

randomized algorithms and arbitrary weights. 

Theorem 3.2. Assume that $(t^) = ri(i/''') for some s > and that there exists a 

p > 1 and a a > such that 



1 + W'i'v.aWK^K,. 



= n 



2 j forallveU. 
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Assume further that j^ij > and that there exists an a > with ej^{B{K^ij))^ = 
n{N~°'). Then we have for fixed subspace sampling 

eNfi^{B{K)f = n (tV-^+^'p-d) , 

and for variable subspace sampling 

eNMB{K)f = n (iV-"""{".^}) . 

Proof. Let Q be a randomized algorithm. In the fixed subspace samphng regime 
our proof is a shght modification of the proof of [IHl Thm. 2]: If costfix((5, B{K)) < N, 
then there exists a set v G 14 and an anchor a G X such that E(costc„ ^ {Q, /)) < + 1 
for every / e B{K). This imphes for every / € B{K) that P(g(/) = Qi^v.a /)) = 1- 
Due to LemmaOwe get e{Q,B{K)Y = 

The expected number of evaluations of Q is at most of order 0{N /\vY). Thus we 
have 

e{Q,B{K)f > e{Q,B{K[,y)f = O |^(^^^ ^ . 
Now it is easily verified that 

(^)"° + i«r"-" 

Let us turn to the variable subspace sampling regime: If costvar(Q, B{K)) < N, then 
there exists an increasing sequence v = {vi)i^jq, 9 ^ Vi G U, and an anchor a e X 
such that E(costc^ ^^(Q, /)) < + 1 for every / e B{K). Let m be the largest 
integer satisfying $"(|u™|) < 4(A^ + 1). That implies for all / e B{K) that f{Q{f) = 
Q(*i.™,a/)) > 3/4. Due to LemmaOwe get e{Q,B{K)f = n{\v„,\''^^-v)). Since 
4(iV+ 1) = n{\v,nY), we obtain e{Q,B{K)Y ^ n{N^^^^). Furthermore, we have 

e{Q,B{K)f > e(Q,i?(/i{i}))2 = n{N-^). 

This concludes the proof. □ 

3.2. Finite-intersection and product weights. As already discussed in Re- 
mark[^?3J for product weights the operator norm ||4'i;.a||i<'->-ii:„ is uniformly bounded 
in V G U, and the same holds true for finite-intersection weights 7 as long as the 
anchor a E X has identical entries a £ D and the monotonicity condition (|2.26p is 
satisfied. 

Lemma 3.3. Let 7 be finite-intersection or product weights, and let p > decay^. 
Let V E U. Then we have b.^ ^ = fl(\v\^~P). 

Proof. Let 7 be finite-intersection weights. Let 77 be as in condition (|2.8p . Note 
that the set {i\ui n w 7^ 0} contains at most ri\v\ elements. Hence 

0/tiCN\'u jell: jeti: 

00 2|i>|r; 

> ln,ku^{a,a)> ^ 7„^fc„^.(a,a) > |u|ry7„,|„i^ = rj . 

3 = \v\ri+l j=\v\7-i+l 
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In the case of product weights, ^ = r2(|w|^~'') was proved in (TS] p. 243]. □ 

Remark 3.1. The statement of Lemma \3.S\ does not hold for arbitrary weights, 
as shown by the following example: Consider weights {"fu)ueu defined 6?/ 7„ > if 
u = [d] for some d g N and 7m = otherwise. Then 

^l,a = 5Z ^y-^u{a, a) = for alllev eU. 

Remark 12.41 Lemma I3.3[ and Theorem 13.21 lead directly to the following lower 
bounds for finite-intersection and product weights. Note that for s = 1 the lower 
bound for product weights in the fixed subspace sampling model has already been 
proved in [T51 Thm. 2]. 

Corollary 3.4. Let 7 be finite-intersection weights or product weights. In the 
case of finite-intersection weights we additionally assume that the weights satisfy the 
monotonicity condition 112. 26\) and "f{i} > 0, and that all admissable anchors a G X 
for fixed or variable subspace sampling are of the form a = {a, a, . . .) for some suitable 
a Cz D. Let ~ ri(i/*) for some s > 0, and let p > decay ..y. Assume further that 
there exists an a > with eN{B{K[ij))'^ = fl{N^°'). Then we have for fixed subspace 
sampling 

eNM{B{K)f = n (at-^^) , 
and for variable subspace sampling 

4. Multilevel Algorithm. In this section, we discuss multilevel algorithms, 
firstly in generality mostly relying on |12j , and subsequently show how to tailor them 
to finite-intersection and product weights. 

4.1. General v^reights. Let us describe the general form of the multilevel algo- 
rithms we want to use more precisely: Let Lq := 0, let Li < L2 < L3 < . . . be natural 
numbers, and let 

4'^ -^e[L.]"j and - M for fc e N. (4.1) 

For general weights we will use the sets v^^\ fc = 1,2, In special cases as, e.g., 

for product weights or the lexicographically-ordered weights defined in [H] , it is more 
convenient to make use of the special ordering of the corresponding set system Uj, 

j e N, and choose the sets vf, for fc = 1, 2, .... In all definitions and results that hold 
for both choices of the i — 1,2, we simply write Vk- Put vq := 0. We will choose 
the numbers Li,L2, ... in general such that \vk\ = Q{b'') for some b G (l,oo). (Here 
a default choice would be Lk = 2*^"^.) Let 

Vi :-{ieN|w, Cvi} 

and 

Vk ■= a eN\uj C Vk and uj ^ Vk-i} for k>2. 
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Let us furthermore define 

oo 

f/(m) —U^^iFfcUjO} and tail^(m) := ^ 7„^., 

where the weights 7„^. are defined as in Subsection [S] Let us fix an anchor a G X. We 
use the short hands := 0, 

*fc:=*ufc,a and := b^,^ for fc = 1, 2, . . ., 

as well as 

f+ f+ and f~ f~ 

JMj/c ■ Ju,Vk o-ii"-^ JMjA; ■ J u,Vk-i,Vk- 

Furthermore, let 

'^k,u • — ^Vk.u^a and Tj^^^ . — '^Vh ^Vk~i,u^a- 

For natural numbers ni > n2 > ■ ■ ■ > n„n we consider randomized algorithms Qvk,a 
of the form 

0.„a(/):=5]u',.fcMfU), w^.u^^t^:""^ eD^\ (4.2) 
i=i 

that satisfy (|2.6p and condition (*) of Lemma [2. II for V = {m C | > 0}. We use 
additionally the shorthand 

Qk{f).= Qv,AI-'^k-if). (4.3) 
Define the randomized multilevel algorithm Q via 

Q(/) := E = E E ^^--^(Z - vl;,_,/)(ta,fc). (4.4) 

k=l k=l j=l 

where the random variables Qkif), fc = 1, . . . , m, are supposed to be independent. 

Since E(Q„,.,a(/)) = /(*fc/) for all k, see Remark O we have E(g(/)) = 
-^(^m(/))- Thus (5(/) is an unbiased estimator of J(^'m(/)), and we obtain 

Ea(/) - Q{f)f = (/(/) - /(*™/))' + Var(Q(/)). (4.5) 

Since Qkif), k = 1, . . . , m, are independent random variables, we have the following 
identity for the variance of Q{f): 

m 

Var(Q(/))=EVar(gfc(/)). (4.6) 
fc=i 

Lemma 4.1. For all f € H{K) and all k G [m] we have 

Var(gfc(/)) - E Var(g.„a(f fc(/+,J)) + E Var(g„,.„(M'fc_i (/-,)))• (4-7) 
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Proof. For k € [to] wg obtain from Lemma 



Var(gfc(/)) = Var ^ 0...a(«'fc(/+ ,,-)) + J2 Qv.A~^ k-iif-^)) 

Recall from Lemma O that *fe(/^. j.) G i^u, and -*fe-i(/^fc) G Since Qv^.a 
satisfies condition (*) in Lemma [^?11 for V = {u C Vk \ ju > 0}, we obtain with Remark 
12.31 and Lemma \2A] 

Var(Q,(/))= ^ Var(Q.„„(*,(/+. ,)))+ ^ Var(Q.„„(*,_i(/-,))). 

The statement of Lemma 14.11 follows after observing that for u = the function 
*fc-i(/0^fc) e i?0 is constant, and therefore also Qv^A'^k-iif^^k))- ^ 
Due'to (031) and gH), we get for / e B{K) 

m 

Wif) - QU)f < E Var(Qfc(/)) + hi (4.8) 

fc=i 

and for k S [to] we have that (|4.7p holds. Assume now that there exist for every 
k £ N algorithms of the form (|4.2p that satisfy p.6p and condition (*) of Lemma [2?11 
for V ~ {u C Vk\ 7u > 0}, and for which there exists a r > and for each u C Vk 
with > a constant Cu.k.r such that 

Var(Q,„a(/„))<C„,fe,r(nfc-l)-ni/n|lL for aU /„ £ i/„. (4.9) 

Then with Lemma [2771 and Remark 1 2. 2 [ we obtain for all / G B{K) 

Var(gfc(/)) 

<( E C.,A.|l*fc(/+,,)|lL^. + E ^^«Ar||*.-i(/-,)llL)(nfc-l)-^ 



< ( maxC„^,fc,^r^ + ^ max C„,fc,^f^. I (nfe - 1) 



Hence 



e(Q,B(7^))2 < ( maxC„^,fc,,r2 + max C„,fc,,f^_J (n^ - 1)"" +b2„ . 

(4.10) 

The aim is now to minimize the right hand side of this error bound for given cost 
by choosing to, Li, ... , and ni, . . . , essentially optimal. To do so, one needs 
more specific information about the constants Cu,k,T and about the weights {'^u)u£U- 

4.2. Finite- Intersection Weights. Let (7„JigN be finite-intersection weights 
of finite order oj. Let 77 G N be such that the set system Uj, = 1, 2, . . ., satisfies (|2.8p . 
Put 



d r]{uj - 1) + 1. 



(4.11) 
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Here we choose the sets Vk — vj^ — Ujg[/^^]Wj in (|4.ip . where the numbers Li,L2, ■ ■ ■ 
will be determined later. Observe that r]~^Lk < \vk\ < ujLk for all k e N. We assume 
that a ~ {a,a, . . .), where a G D satisfies (|2.15p . Notice that this assumption leads to 

< min{l, k{a, a)"} < fc„^. (a, a) < max{l, k{a, a)"} for all j e N. 

Proposition 4.2. Assume that for d given by (|4.1ip and all n e N there exist 
randomized linear algorithms Qn ~ Q[d],n of the form ^2.4\ l, that satisfy condition (*) 
of Lemma \2.1\ for V — {u Q [d]} , and for which there exist constants a, {3, and Cd, 
independent of n, such that 

Var(Q„(/„)) < Cdn-"ln(n)'9||/„||2^ for all u C [d], fu G H,,. (4.12) 

Then we find for all fc G N and all rifc G N randomized linear algorithms Qv^.a of the 
form {4-2^ , that satisfy condition (*) of Lemma \2.1\ for V ~ {u Q Vk\^u > 0} and 

Var(Q,,,„(/„J) < Canl'^HnufWfuM^^ for all u, C v^, fu, G H^,. (4.13) 

// all Qn satisfy \2.6\) . then the Qvk,a satisfy i2.6\) . too. 

Proof. Consider for given Uk the algorithm Qn^ • Due to Lemma 12.31 we find a 
mapping </> : N — > [d] such that for all j G N the restriction is injective. We obtain 

the random point t^j;'^'' G -D"'' by defining its i^tli component by 

4^5(l.) :=x«^)(l.^(,)) forall^.G«fc,c.G^![''l,^ = l,...,nfc. (4.14) 

Notice that the projection of tl^'^'' to [0,1]"^ for ilj C Vk consists of \uj\ different 
components of x^'^\ We choose the coefficients of Qv^.a to be the coefficients of Qn^, 
i.e., Wj^k ■= Wj. Observe that the resulting randomized algorithm Qv^.a satisfies 
condition (*) of Lemma [2.11 for V = {u C wj. | > 0}. It is easily seen that (|4.13p 
holds. □ 

4.2.1. Variable Subspace Sampling. In the variable subspace sampling cost 
model we have the following result on the multilevel algorithm and finite-intersection 
weights. 

Theorem 4.3. Assume that for d given by (j4.1ip and all 71 G N there exist 
an algorithm Q„ = Q[d].n in the condition of Proposition that satisfies 112.6\} . 
Consider the multilevel algorithm Q defined in Ii4.4\ l, where the algorithms Qv^,a are 
as in Proposition \4-2\ Let N be the cost of the algorithm corresponding to the cost 
function $(zy) = Olv^) for some s > 0. Then there exists for all d > a constant 
C = C{d, 6) such that 

e(g, B{K)f < CN-°'+^ if decay^ >l + as, 

and 

e(g, B{K) f < CjV~ '"""'»"''' +'^ ifl + as> dccay..^ > 1. 

In the case, where the assumptions of Corollary 13.41 hold for the same a as in 
Theorem 14.31 our lower bound on ejv.var(-B(X)) shows that the upper bounds in 
Theorem 14.31 are essentially sharp. 



18 



Proof. Let / G B{K). Due to Proposition we find for every (5 > a constant 
C = Cd.s with 

Var(Q„„„(*fc(/+_,))) < Cn-("-^')||vI/,(/+_,)||2^^ 

for all j G Vfc, and 

Var(g,,„„(vl/,._i(/-,))) < Cnl^'^-'-^\\^u-i{f-k)\\l. 
for all u C Vk-i- Furthermore, Lemma 12.71 gives us 

and 

||*.-i(/-,)|lL<r^,J|/-,.||^. 

Now 

rl^^ - 0(tail^(fc - 1)) and rt_„ = 0(tail^(fc - 1)), (4.15) 
and we set at ■— tail-^(fc — 1) for fc = 1, 2, . . .. We get from (|4.7p 



Var(gfc(/)) =0 n^*" "^Vfei ^ ll^„^.,s^ll^^-r ll^„,fc-illx ) h 



and the two sums in parentheses are bounded by 2||/||j^ < 2, see Remark 12.21 Hence 

Var(gfe(/)) = O (n-^^-'^ak) . (4.16) 
Thus we have, due to (|4.8p and since 6^„ = 0(tail-y(m)), 

e(Q, B{K)f - 1^ + . (4.17) 

Let S > M, where M J2™=i -^t' ^'^ given. We assume that Lk = L\A'^~\ for a fixed 
L e N and A > 1. We want to find the minimum x* = {xl, . . . , x^) of the function 



G{x) = ^ o-^-Xj, ^" ''^ subject to the constraint ^ aj^L^ = 5*. 



-{a-5) 

k=l k=l 



Due to Lagrange's multiplier theorem there exists a A G M such that gradG'(a;*) = 
A(ijf , . . . , Lfji). This relation and the constraint imply that the minimum x* is given 

by 



\ -1 

1 (a-S)s 



Car-'Ll^^'-', where C = ^ J^ar^-L^-M . (4.18) 



\fe=i 

For fc = 1, 2, . . . , m we choose Uk := [xj!] . This leads to 



iV = O n^Ll = 0(5 + M) = 0{S). 



\k=l 



19 



We have 

fc=l \A;=1 / 

Let p e (Ijdecay^), then tri = and ak = O(i^l^) for k > 2. Thus we have 
altogether 



Case 1: decay^ > 1 + cts. Then we may choose p such that (a — S)s < p — I. 
Choose m such that S ~ Q{Lm^^ ), then 

e{Q,B{K)f = O (s-^'^-^A = O (n~^''~^^ 



Case 2: decay^ < 1 + as. Then, for S small enough, we get {a — S)s > p — 1. 
Choose m such that 5 = 8(i^), then 

□ 

4.2.2. Fixed Subspace Sampling. In this subsection, we discuss fixed sub- 
space sampling. For some fixed L G N let 

v :^ \J U.J. 

We focus on algorithms of the form 

n 

Q(/) = Q«,a(/) = ^«;J(t«,a). (4.19) 

We interpret the "unilevel algorithm" Q(/) as a multilevel algorithm with m = 1, 
L\ = L, vi = V, and ni ~ n. Notice that the upper bound in the next theorem is 
essentially sharp, as can be seen from the corresponding lower bound in Corollarv l3.4l 
Theorem 4.4. Assume that for d given by (|4.1ip and all n N there exists an 
algorithm Qn = Q[d].n o--'' condition of Proposition that satisfies \2.6\) . Let 

Q = Qvi,a be as in Proposition \4-2\ Let N he the cost of the algorithm corresponding 
to the cost function %{v) = 0{v^) for some s > 0. Then there exists for all 6 > a 
constant C ~ C{d, 5) such that 

(a-a)(decay.., -1) 

e(Q, B{K)f < CN (°-*)=+io-yT -i . 



Proof. Since our algorithm Q = Qy^^a is a multilevel algorithm with m = 1, we 
have just to follow the proof of Theorem l4.3l and modify it slightly. Let p S (1, decay^). 
From (|4.17p and (|4.18p . we obtain for the choice ni := \x\\ 

e(Q, B{K)f = o(5-("-*)2,("-*')- + 

where S = Q{niL\) and N 0{S). We set 

5':=e ), resulting in e{Q,B{K)f = O {N^ A . 

□ 
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4.3. Product Weights. In this subsection, we diseuss product weights, dealing 
with variable and fixed subspace sampling separately. We assume that a = (a, a, . . . ), 
where a <E D satisfies (|2.15|) . Furthermore, we choose Vk — w^^' = [Lk] in (|4.1I) . 

4.3.1. Variable Subspace Sampling. In the variable subspaee sampling cost 
model we have the following result on the multilevel algorithm and product weights. 

Theorem 4.5. Let $(zy) = 0{v'') for some s > 0. Assume that there exist for 
every fc G N algorithms of the form (j4.2p that satisfy h2. 6\) and condition (*) of Lemma 
\2.1\ for V = {u C Vk\. Let a > 1, and let t :~ minja, decay^} — 5 for some S > 0. 
Assume further that ^4-^ holds for all u C v^. and that for all j £ 

Cu„k,rlu, = 0{Llr\) , (4.20) 
where p :— decay^ —Ss, and for all 9 ^ u C Vk-i 

Cu,k,rlu = 0(1) . (4.21) 

Consider the multilevel algorithm defined in (j4.4p , and let N he the cost of the algo- 
rithm corresponding to the cost function Then we obtain for s > 

e(Q, B{K)f = 0{N-"+^), if deeay^ > 1 + as , 

decay _^ — 1 

e(Q, B{I<)f ^ 0{N ^ +^), ifl + as> decay^ > 1 , 

and for > s > 0, 

e{Q,B{K)f = 0(Ar-"+''), if decay ^ >a, 

e{Q,B{K)f = 0(iV-'^^^"y-+^), ifa> dccay^ > ^— , 

' 1 — s 

decay-, - 1 1 

e{Q,B{K)f = 0{N if > decay^ > 1 . 



In section [5] we will see that condition (|4.20p and (|4.2ip are quite natural and 
are, in particular, satisfied by scrambled polynomial lattice rules constructed via a 
component-by-component approach. 

Assume that we have eN{B{Ks^iT^))'^ = VL{N^°'). Then we see that for cost func- 
tions %{v) — 0{v^), where s > the upper bounds in Theorem l4.5l are essentially 
sharp, as confirmed in Corollarv l3.4l Furthermore, for > s > 0, the upper bounds 
are essentially sharp in the regimes decay^ > a and > decay ..j, > 1. The case 
s > ^— !- is more interesting and relevant in applications than the case > s > 0, 
see, e.g., [101 [251 EH. 

Proof. Let Lk = L\A''~\ for fixed i G N and A > I. We use the analysis from 
Subsection mi] and get (|4.10p . We have 

and 

^'k,u — ^'vk,Vk-i,u,a= 7'!iUio'fcm' (a, a) 
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07^U)'CN\l)fc„i 



Now we have 



J2 7»'fc(a,a)''"'' = n (l+7,fc(a,a))-l 

=fc(a,a)0(4:?) (l + o(l))==o(4:? 
From this we obtain 

rlu = 0{luLlrl) and hl = OiLl-P). 
Thus we have from Equations (|4.20|) and ()4.2ip 

e(g, B{K)f = o(^ Llr_\{nu - l)"^ + L.^r^^ . (4.22) 

We use the notation ak '■= L].Z.i and M := J2k=i ^k- ^et S > 2M be given. Arguing 
as in the proof of Theorem I4.3[ we choose = \x*^ + 1, where 

/ ^ \ -1 

1 — p + s 



xl=c{L^^j and C = 5 ( ^ ) . (4.23) 

This leads to 
We now have 

^4:^(n..-i)-<5-K:i,-^ 

fc=l \A;=1 / 

= 0(5--(l + Li-P+-)) 

We set S* = e(L^) and obtain 

e (Q, i?(if))2 = O (5-- + 5--L^-^'+- + L^-P) 



= o\s 

We consider two cases, s > and ^— !- > s > 



•j^ininj^a.dccay^ , ^^^^ - 
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Case 1: If s > wc consider two subcases. If decay ..^ > 1 + as, then we have 
'^^'^'^^^ — 1 > Q, and decay > a. Hence 

e{Q,B{K)f ^0{S~'^+^) . 

If 1 + as > decay ..^ > 1, then '^'^'^''^^^ — 1 g (q, a). Moreover, s > implies decay^ > 
^i^^^. Thus 

e{Q,B{K)f = O [s-'-^^^^+' 
Case 2: If > s > 0, we consider three subcases. If decay^ > a, then 

decay — 1 

— > a. Hence 

e{Q,B{K)f = 0{S-''+') . 
If a > decay ..J, > then '^"'^'^'^^ — ^ > decay ..j,, and 



e(Q, B{K)f = O {S- '^""''^■y +^) . 
Finally, if > decay^ > 1, then decay ..j, > — and 

/ decay— — 1 

e{Q,B{K) f = O (S ^ 

□ 

4.3.2. Fixed Subspace Sampling. For fixed subspace sampling, our analysis 
recovers Theorem 1 from [18] . 

5. Example: The Unanchored Sobolev Space and Scrambled Polyno- 
mial Lattice Rules. In this section, we apply the results from Section |4] to a par- 
ticular function space, the unanchored Sobolev space, and employ a particular class 
of quadrature rules, namely scrambled polynomial lattice rules. 

5.1. The Unanchored Sobolev Space. We recall the unanchored Sobolev 
space, which is also discussed for example in [HI |27l |37]. Let fc : [0, 1]^ — > K be 

the unanchored kernel given by 

k{x, y) = 1/3 + {x^ + y^)/2 - max(x-, y). 
Regarding the anchor, we fix a = ^ and set a — (a, a, ... ) which minimizes 

ueu ueu 

see e.g. [TB]. For u ^ % the space iJ„ consists of all absolutely continuous functions 
/ such that the weak derivative = ^ ^'"g^. / satisfies e i2([0,l]") and 

fiv) '^Vj = fo'' j ^ We have 

ll./lll= / (/'"^(y))'dy. 



Remark 5.1. We recall from \MI, Section 2.2.9, Proposition 1, that the Nth 
minimal integration error in the Sobolev space 

1^2^10, 1]) is of order n{N-^/^). For 
7{ii, > the space W2^([0, 1]) is obviously continuously embedded in H{K^iy), thus 
implying eN{B{K{^})f = n{N-^). 
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5.2. Scrambled Polynomial Lattice Rules. In this subsection we recall a 
result on scrambled polynomial lattice rules that will be used in Subsection l5.3l Poly- 
nomial lattice rules were introduced in [53] , see also [71 [51 [53] . For background on the 
scrambling algorithm, we refer the reader to |291 130| , for background on scrambled 
polynomial lattice rules and finite-dimensional integration results, we refer the reader 
to [3] . The proof of the following result is given in the Appendix. 

Theorem 5.1. Let {'ju)ueu be general weights. Assume that Vk, for fc G N, is as 
in Section^ Then for all k, Mk G N, there exists a scrambled polynomial lattice rule 
{^j}"=i ^ [Oi l)"'; where Uk ~ b^^'' and b a prime, such that the algorithm 

Q...n.(/) = -E/(^«)' (5-1) 

z— 1 

satisfies condition (*) of Lemma \2.1\ for V = {u C u^}, and we have for all 1 < t < 3 
and all u C Vk, 

Var(Q^,,^„,(/„)) < Cu,k,r{nk - l)"^||/u||fc„ for all fu G Hu, 

where 



Cu,k,r^ I E ^'^^Ia I 



here Ch^\ is given by 



CM:=max(^^^3^^^,^^^^j , (5.2) 

and Zu = maxM, u C N. 

We remark that the scrambled polynomial lattice rules referred to in Theorem 
15.11 can be constructed using a modification of the component-by-component (CBC) 
algorithm from [^, see the Appendix. 

5.3. Results for multilevel algorithms. In this subsection, we present results 
for the multilevel algorithms from Section U] for the space of integrands H{K) based 
on the unanchored kernel k discussed in Subsection 15.11 We rely on the scrambled 
polynomial lattice rules from Theorem 15.11 We remark that scrambled polynomial 
lattice rules consist of n points, where n is the power of a prime, see Theorem 15.11 
and cannot be constructed for all n g N, as stated in the propositions and theorems 
of Section UJ However, when required to construct a quadrature rule consisting of 
n points, where ri G N, we simply construct a scrambled polynomial lattice rule 
consisting of points, where < n < b^^^^, and we set the quadrature weights 
corresponding to the superfluous points equal to zero. 

5.3.1. Finite-Intersection Weights. We now present results for finite-inter- 
section weights distinguishing between variable and fixed subspace sampling. 

Variable Subspace Sampling. For finite-intersection weights and variable sub- 
space sampling, we have the following result, which is essentially optimal in the case 
where the monotonicity condition (|2.26|) holds and 7{i} > 0, see Corollarv 13.41 and 
Remark 1 5. II Let again d be as in (|4.11|) 

Corollary 5.2. Let $(i^) = 0{h'^) for s > 0. Let Qn = Q[d],n be the algorithm 
Qvi,ni from Theorem ] 5. 1\ with n-\ = n andvi ~ [d]. Consider the multilevel algorithms 
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Q defined in {4-4% where the algorithms Qv^,a ^.s in Proposition \4-^ Put N := 
costvar(Qj B{K)). Then there exists for all S > a constant C ~ C{d, 5) such that 

e{Q, B{K)f < CN-^+^ if dccay^ > 1 + 3s, 

and 

decay— — 1 

e(g, B{K)f < CN ^ +^ if 1 + 3s > decay^ > 1. 

Proof. We need to verify that the conditions of Theorem l4.3l arc satisfied. Scram- 
bled polynomial lattice rules Q[d],n are of the form (|2.4p . satisfy condition (*) of 
Lemma [2. II for V := {u C [d]}, and (|4.12p for arbitrarily small £ > 0, a = 3 — £ =: t, 

/3 = and 

Q= ( E 

\07^luC[d] 

where Cb^x is given by (|5.2p and we simply set 7ti = 1 for all u C [d] in Theorem 15.11 
□ 

Fixed Subspace Sampling. For fixed subspace sampling, we obtain from The- 
orem [4]4] the following result, which is essentially optimal according to Corollarv l3.4l 
and Remark l5.ll 

Corollary 5.3. Let = O^v'^) for some s > 0. Let Q„ ~ Q[d].n be the 
algorithm Qvi.m from Theorem \5. 1[ where ni — n and vi = [d]. Let Q = Qvi,a be 
as in Proposition \4-Z\ Put N := costvar (Q, B(K)). Then there exists for all 6 > a 
constant C = C{d,d) such that 

(3-a)(docay-, -1) 
e{Q,B{K)f < CN (3-5) =+decay, -l _ 



5.3.2. Product Weights. For product weights, we have the following results, 
where we again distinguish between variable and fixed subspace sampling. 

Variable Subspace Sampling. For variable subspace sampling we obtain the 
following result, which is essentially optimal for cost functions ${1/) ~ 0{i''^), that 
satisfy s > |. For | > s > 0, the results are optimal for the regimes decay^ > 3 and 
Yz-^ > decay^ > 1, see Corollarv 13.41 and Rcmark l5.1l 

Corollary 5.4. Let (7u)„g;^ be product weights and consider the algorithm 

in 

fe=l 

where the Qv^.a oltc related to the scrambled polynomial lattice rules Qvf.,rn, from 
Theorem ] 5. 1\ via 0„, r, = Qvk,nk°^ k- Let N be the cost of the algorithm corresponding 
to the cost function ~ 0{v'') for some s > 0. Then, for arbitrarily small 5 > Q, 
we obtain for s > |, 

e{Q,B{K)f = 0{N-^+^), if decay > 1 -(- 3s , 
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e(Q, B{K)f ^ 0{N ^ +'^), 1 + 3s > decay^ > 1 , 

and for | > s > 0, 

e(Q, B{K)f = 0(Af-3+'5), ^cc&y^ > 3 , 

decay-, - 1 1 

e(Q, B{K))^ = 0(iV ^+^), > decay^ > 1 . 

1 — s ' 



Before proving Corollary 15.41 we compare it to the results obtained in [2] and 
|18j . where the case s = 1 was treated. So let s = 1. In [18], the rate of convergence 
3 — 6,5 arbitrarily small, was achieved for decay^ > 11, see Corollary 4, and in [2] 
for decay^ > 10. Using our analysis, we achieve this rate for decay^ > 4, a result 
which is optimal, see Corollary 13.41 and Remark 15. 1[ and thus cannot be improved 
further. In the remaining regime 4 > decay^ > 1, the result of Corollarv l5.4l is again 
essentially optimal and improves clearly on the results from [5] and |18| . 

Proof. We need to verify the conditions of Theorem 14.51 Since we base the 
algorithms Qy^, „ on the scrambled polynomial lattice rules from Theorem 15.11 we 
obtain (|4.9|) for all 1 < r < 3. Wc now confirm that the constants Cu,k,T satisfy 
Equations (|4.20p and (|4.2ip respectively. For w S Wfc, we have 





For T £ (1, decay^), since we deal with product weights, we obtain for j G Vk 
and hence Cuj.k.rluj = O [L~^^^ for each p < decay^. For 7^ w C Vk-i, 




so Cu,k,Tju — O (1) as required. □ 

Fixed Subspace Sampling. We can combine Theorem 1 from [18] with scram- 
bled polynomial lattice rules to recover Corollary 3.1 from [2], which used Theorem 1 
from TE] to improve on Corollary 1 from [T5] . 

Acknowledgments. Michael Gnewuch was partially supported by the German 
Science Foundation DFG under grant GN91-3/1 and by the Australian Research 
Council ARC. 

Appendix A. Scrambled Polynomial Lattice Rules. 

The quadrature rules employed in Section [5] are based on scrambled polynomial 
lattice rules, which we now recall mostly relying on [3]. 

Polynomial lattice rules were introduced in [53], see also [7] (5] 123] ■ We recall 
that 5 is a fixed prime and denote by the finite field containing b elements and by 
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^)) the field of formal Laurent series over Zf,. Elements oiZi,{{x ^)) are formal 
Laurent series, 

CJO 

l—w 

where w can be an arbitrary integer and all ti are in Zi,. The field Zih((x~^)) contains 
the field of rational functions over Zb as a subfield. Finally, the set of polynomials over 
Zb is denoted by Zb[a;]. For an integer M, we denote by I'm the map from Zb((a;~^)) 
to [0, 1) defined by 



M 

I 



\l—w / /— max(l,i(;) 



The following definition of polynomial lattice rules stems from [21] , see also [SJ [53] . 
Recall that a quasi-Monte Carlo rule is a linear quadrature rule whose quadrature 
weights are all equal and sum up to one. 

Definition A.l. Let b be prime and M be an integer. For a given dimension 
s > 1, choose p{x) £ Zb[a;] with deg{p{x)) = M and qi{x), . . . ,qs{x) G 1h\x\. For 
< h < b^^ let h = ho + hib + • • • + /im-i^*^~^ be the b-adic expansion of h. With 
each such h we associate the polynomial 

M-l 



h{x) = hrX^ G Zf,[x] . 



r=0 

Then Sp^m{q), where q = {qi, . . . ,qs), is the point set consisting of the b^^ points 

(^) (^))^ 

for < h < b^' . A quasi-Monte Carlo rule using the point set S'p^m(q) is called a 
polynomial lattice rule. 

Regarding notation, we write h for vectors over Z or R. Polynomials over Zb 
are denoted by h(x) and vectors of polynomials by h{x). Finally, we introduce the 
dual lattice which plays an important role in numerical integration, see [7| [5] , which 
requires us to introduce the following function: for a non-negative integer k with b- 
adic expansion k ~ kg + kib + . . . we write trj\/(fc) = ko + kib + ■ ■ ■ + kM-ib^^^^ and 
thus the associated polynomial 

trM(fc)(a:) = + kix + . . . ku-ix^'^'^ & Zb[x] 

has degree < M. For a vector fc e Ng, trA/(fc) is defined componentwise. We fix a 
polynomial p{x) € Zb[a;] with deg{p{x)) — M. 

Definition A. 2. Letq{x) = {qi{x), . . . ,qs{x)) E Zi,[xY , then the dual polynomial 
lattice of Sp^M{q) «s given by 



V = Vp{q) = <j fc e : J2 tTmikj)ix)qjix) ee (mod 
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Also, we set V — 'D\ {0} and use the notation 'Dp{q^) to denote the dual lattice 
corresponding to the generating polynomials qj, j G u, and define I?'(<7„) analogously. 
The following function plays an important role in the analysis of polynomial lattice 
rules 



r{l) 



1 if Z = 

3^ in>o 



where / = lo + lib-\ \-lab'', la 7^ 0, and for Z„ G Ni,"' we set r^{lu) = 7«h Hj&Uh ''('j)' 

where = {j G u : Ij > 0}. 

We now recall Owen's scrambling algorithm introduced in |291l30j . The scrambling 
algorithm is best illustrated for a generic point x E [0, 1)'*, where x = (xi, . . . ,Xs) 
and 

Then the scrambled point shall be denoted by y e [0, 1)", where y = (yi, . . . , y^), 

Vj ^ + ^2 +■■•■ 

The permutation applied to ^j./, j = l,...,s, depends on ^j.fe. for I < k < I. In 
particular, -qjs = TTji^j.i), Vja = tTj.^j i (Ci,2), ?7j,3 = TTj.Cj.i.ii, 2(^5,3) and in general 

V3,k = 7rj^,i,...,4,,,._i(Cj,fc) , fc > 2 , 

where ttj and Tr^^j^. 1,....^^ fc > 2, are random permutations of {0, 1}. We 

assume that permutations with different indices are mutually independent. Using V 
to denote a point set in [0,1)^ and Vt, to denote the point set resulting from the 
application of Owen's scrambling algorithm to the points in P, it is known from |29j . 
see Proposition 2, that each point in V^^ is uniformly distributed in [0, 1)'*. Using 
Owen's scrambling algorithm to randomize polynomial lattice rules, we are able to 
obtain the following estimate on the variance of a quadrature rule based on a scrambled 
polynomial lattice rule. 

Theorem A. 3. Let b be prime, M an integer and set n — b^^ . Assume s G N 
and that (7u)„g;^ are general weights. We set 



1 " 



n 

i=l 



where {xi}"^^ G [0, 1)" is based on a scrambled polynomial lattice rule, and obtain for 
all u C [s] 

Var(Q[,],„(/„)) < ^^(l^hu'WfuWl- (A.2) 

Theorem IA.3I can be verified by recalling that polynomial lattice rules are digital 
nets, see e.g. [51 and using the proof approach of [S] Corollary 13.7]. The coeffi- 
cients (T^j o)(/) appearing in that proof can be bounded in terms of the norm || • 
with the help of the analysis in the proof of [371 Lemma 6] . 
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For u C Vk wc can use the bound 

J2 ^'-yi^-)^ E E r^i^^o)=■■B{qAzu]n^'-'>), (A.3) 

ill en" z^£wC\zu] in, eH™ 

where 

^(f") = for w C [z„ - 1] and ^^"'> = 7^ for z„ e w C [z„] , 

where = maxu, u C N. 

Appendix B. Constructing Polynomial Lattice Rules for the Unan- 
chored Sobolev Space. 

The aim of this section is twofold: Firstly, we would like to discuss how to imple- 
ment the multilevel algorithm from Section [5] in practice, and secondly we would like 
to establish Theorem 15.11 The construction of the scrambled polynomial lattice rules 
underlying the algorithm from Section 2] is based on the componcnt-by-component 
(CBC) construction from [3]. In [3], the construction was presented in the context 
of a Walsh function space and product weights, whereas we arc going to present the 
results for the unanchored Sobolev space from Subsection 15. II and general weights. 

We will illustrate how to construct the scrambled polynomial lattice rule under- 
lying the algorithm Qvk,a, see Equation (|4.2p . To do so, we proceed as follows: We 
note that the sets (vk)keN from Section 2] satisfy wi C V2 C ^3 C . . . , hence we firstly 
construct a scrambled polynomial lattice rule corresponding to the set vi, i.e. con- 
struct a point set in [0, 1)^^. Subsequently, we extend this point set to a scrambled 
polynomial lattice rule corresponding to the set V2, i.e. construct points in [0,1)"^. 
Next we extend this point set to a scrambled polynomial lattice rule corresponding 
to the set W3, i.e. construct points in [0,1)"^, etc.. Hence we need to present two 
algorithms; the first algorithm, CBC 1, shows how to construct scrambled polynomial 
lattice rules corresponding to vi in [0,1)'"^, the next algorithm, CBC 2, shows how 
to extend a scrambled polynomial lattice rule corresponding to Ufc-i in [0,1)"''"^ to 
a scrambled polynomial lattice rule corresponding to Vk in [0, 1)"'", for k ~ 2, 3, ... . 
Clearly it suffices to show how to construct the polynomial lattice rule corresponding 
to vi and then how to extend it to a polynomial lattice rule corresponding to V2- 
Without loss of generality, we assume that vi = [si] and V2 = [52], where si, S2 G N, 
and Si < S2- We now discuss how to construct a scrambled polynomial lattice rule 
in [0, 1)*^ using the CBC construction. Intuitively, the CBC construction chooses the 
polynomials 51, . . . , q^^ in a greedy fashion: The first polynomial qi is chosen so that 
a given quality criterion is minimized. The resulting polynomial is then fixed, say 
gjf, and consequently the second polynomial q2 is chosen so that the quality criterion 
is minimized. The resulting polynomial, say (721 is now fixed and we continue this 
procedure. We note that the quality criterion plays a crucial role for the CBC con- 
struction, and we use B{q, [zti],7^^"'') from (|A.3p as quality criterion to construct the 
scrambled polynomial lattice rule in [0, 1)^". This criterion is closely related to the 
bound on the variance from Equation (jA.2[) . and we have for all u C [si] 

Var(g[,^],,(/„)) < B{q, 7^'"^)7.^'ll./n|lL for ah /„ e (B.l) 

To be useful for the CBC 1 algorithm, wc need the quality criterion B{q, [zu],J'^^"'') to 
be computable. The following theorem provides an explicit formula, see [31 Lemma 1]. 
Theorem B.l. Let b be prime, M an integer and set n ~ b^^ . Then the following 
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equality holds for q — {qi, . . . , (J[z„]) and the point set Sp^A/C?) = {3^j:}i=i for u C [si] 



where 

1 

6-2-052 /ore, = 0,i = l,...,ao-l,eao^O,ao>l, 



I h+T ■/^"'^ a; = 



(& + !) 



where x — ^ + 



We now briefly recall the CBC algorithm from [3], but immediately present it for 
general weights. The generating polynomials of the polynomial lattice rule are chosen 
from the following set 

Rb,M ■= {q e 'Z>b[x] : dcg{q) < M and q 7^ 0} , 

so \Rb,M\ = - 1. The CBC algorithm constructs age so that B{q, [e], 7^"^)), 

e = 1, . . . , si, converges at a rate of 0{n~^^^), for any 5 > 0. 

Algorithm 1 CBC 1 algorithm 

Require: b a prime, si,M G N, an irreducible polynomial p G Zi,[x] with dcg(p) = 
M, and weights (7«)„c[si]- 
1: Set qi = 1. 
2: for e = 2 to Si do 

3: find qe G Rb.M by minimizing B{{qi, . . . , q^), [e],'/^^-') as a function of qe- 
4: end for 

5; return q = {qi, ...,qsj. 



The next theorem is the analogue of Theorem 1 in [3] , but immediately presented 
for general weights. 

Theorem B.2. Let {'yu)u£U be general weights. Assume that the vector q = 
(qi, . . . , g<,i) is obtained using the CBC 1 algorithm, see Algorithm[l[ Then we have 
for all 1 < T < 3, u ^ [si], 

where Cb,\ is given by (|5.2p and z„ = maxw. 

We now discuss how to extend the vector q = {qi, . . . , qs^) from Theorem IB. 2 1 to 
a vector (qi, ...,^32): where S2 > si- Intuitively speaking, we employ the polynomials 
(ji, . . . , (7si constructed via the CBC 1 algorithm, and simply continue the CBC search, 
now constructing polynomials q^j+i, . . . , gs^- This is formalized in Algorithm [2l the 
CBC 2 algorithm. 

We get the following corollary to Theorem IB.2[ which shows that Algorithm [2] 
achieves the essentially optimal rate of convergence. 

Corollary B.3. Let {^u)ueu be general weights. Assume that the polynomials 
qi, . . . , (7sj are given and that the polynomials qsi+i, ■ ■ ■ ,qs2 c obtained via Algorithm 
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Algorithm 2 CBC 2 algorithm 

Require: feaprime, si,S2tM S N, wheresi < S2, an irreducible polynomial p £ Z(,[a;] 
with deg(p) = M, weights (7u)„c[s2] ^^^^ polynomials qj, j = 1, . . . , si. 
1: for e = si + 1 to S2 do 

2; find G ^^b.A/ by minimizing B{{qi, . . . , ge), [ejj'y^'^^) as a function of Qe- 
3: end for 

4: return q = {qi, ...,qs2)- 



[3 Then we have for all I < t < 3 and u C [52], 



where Cb,\ is defined as in (j5.2p and 2„ = maxM. 

Due to Theorem IB. 2[ Corollary IB.3| and Equation (jB.ip . our approach provides 
US with a scrambled polynomial lattice rule {x.i}^^^ S [0, 1)^'' , such that the algorithm 

rik ^ 

1—1 

satisfies the claims made in Theorem 15.11 
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